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Abstract. This note presents a simple and elegant sampler which 
could be used as an alternative to the reversible jump MCMC method- 
ology. 
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■ 1. Introduction. This note is about the problem of performing posterior 

pLn ■ Bayesian inference via Markov chains when the dimension of the model is 

Tij- ! not fixed. The standard solution is the reversible jump MCMC approach 

^ I described in Green (1995). The set-up is typically of the form p{y\6^''\ k), so 

that a model for data y is described for each A; = {1, 2, . . .} and the parameter 
V-/ ■ for model of dimension k is 9^''\ A prior distribution is now assig ned to e^^K 

^ . say 7rk{6^^^), and a prior for k, say 7r{k). 

So let us write the (incomplete) joint density for (y, 9^''\ k) as 
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p{y,e^'\k)=p{y\9^'\k)7rk{e^'^)n{k). 



^ ' This is incomplete (though obviously a valid model) since there is nothing 

^ ■ about the {O'^^^^j ^ k). So let us add a distribution for {0'^^^;j ^ k) when 

model k is conditioned on; 



Piy,i6^^^;j = l,2,...),k)=piy,e^'\k) J] piO^'Y'^'^) U pie^'Y'''^), 

Q\ ' l=k-l l=k+l 

o ■ 

where the choice of p{6'^^'>\0'^^^^^) and p{6'^^'^\0^^^'^'>) is arbitrary. The marginal 
model is correct, just integrate out the {0^^^;j k). So the latent variables 
{6^^^;j 7^ k), conditioned on k, would at first sight not to be needed, but 
they play a crucial role in that they serve as the proposal move between 
dimensions. 

The problem now is how to move between dimensions, since the choice 
is infinite and so the precise probabilities can not be found. However, for 
this we will introduce another latent variable u which facilitates the moves 
in that it makes the choice finite and hence probabilities can be computed. 
We write p{u\k) for this and for simplicity of exposition, though it is easily 
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allowed to be more general, we take u = k + 1 with probability q and u = k 
with probability 1 — g, for all k. So, overall, the joint density being considered 
is 

p{u, y, {e^^^-j = 1, 2 . . .), A;) = p{u\k) p{y, {O^^^-j = 1, 2, . . .), A;). 

We are now in a position to describe the Gibbs sampler for dimension jump- 
ing. 

2. The Gibbs sampler. Suppose the chain is currently at k. Then we 

sample 6^*^^ from TVk{0''''^\y, k) oc p{y\9'^''\ k) TTk{9^''^) in the usual way and 
typically this is not an issue in such dimension varying models since it is 
done assuming k is fixed. Now, given k, we will also sample 9^'^+^^ from 
^(^((fe+i)!^^^)) and 9^'^^'^^ from p{9^'^^^^9^'^^). We need these two since the 
moves from k can be to {k — l,k,k + 1}. The choice of these conditional 
densities is precisely for the same reasons that particular moves are suggested 
in the reversible jump MCMC approach; basically, to increase the chance of 
a move away from k. 

Once this has been done, the u is sampled, and is either k or k + 1. Let 
us assume it is + 1, so that the next k, we will call it j, can be either k or 
k + 1. Now, clearly, we have 

7r{j^k + l\u^k + l,...)(x{l-q) p{y, 9^^+'-\ k+l) p{9^^^\9^^+^^) 

and 

7r(j = A;|m = /fc + 1, . . .) oc qp{y, 9^^\ k) p{9^^+^^\9^''^). (1) 

All the other latent variables and their densities are common to, and hence 
cancel out from, both terms, and so are not needed. 

On the other hand, ii u — k then j can be either A; or ^ — 1. It is then 
easy to derive that 

7r(j ^k\u^k,...)(x{l- q) p{y, 9^^\ k) p{9^^-^^\9^^^) 

and 

7r(i = A; - l|w = A;, . . .) oc qp{y, 9^^-^\ k - I) p{9'^^^\9^^-^^). (2) 

Either way, j is easily sampled. 

There is a special case which deserves attention and this is when we insist 

on 

for all A;. Then, for probabilities (1), we now have the simpler situation, 
7r(j = A:+ l|w = A: + 1,...) oc (1 - g) A; + 1) 7r(A: + 1) 
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and 

7r(j = k\u^k + l,...) oc qp{y\0^''\ k) 7r{k), 
and for probabilities (2), we have 

7r(j = k\u = k,...) <x {l-q)p{y\e^^\k)T^{k) 

and 

7r(j = k-l\u = k,...) (X qp{y\e^^-^\ k - I) 7r{k - 1). 

Once the idea of the Gibbs sampler has been understood, a generalization 
to more types of moves is quite straightforward, and this would involve a 
modification of p{u\k). 

3. Discussion. In summary, the algorithm is as easy as follows, given k: 

1. Sample 9^''^ from Trk(6'^''^\y, k), and sample 6^^~^^^ and 0^^~^^ from "pro- 

posals" and respectively. 

2. Sample u from p(u\k) so that u = k + 1 with probability q and u = k 

with probability ^ — 1. 

3. Sample the new j from the appropriate probabilities (1) or (2). 

Unlike the reversible jump MCMC approach we don't actually need any 
special relation between p[6^^^\6''^~^^) and p{6^^~^^\6'^^'>), though the proba- 
bilities (1) and (2) are simplified if they do satisfy a particular relation (3). 
This is because there is no pressure to force a detailed balance criterion. So, 
we have described a Gibbs sampler version of the reversible jump MGMG 
approach which shares features such as the evidence of proposal moves but, 
as we have just said, removes some of the pressure, and also lacks the need for 
a Jacobian. Also, unlike reversible jump MCMC there is no need to explain 
the algorithm; it is self evident and remarkably simple. 

It would be quite easy to demonstrate in particular cases a more effi- 
cient algorithm has been introduced when compared to the reversible jump 
MCMC. No doubt it would also be achievable the other way round. This is 
rather beside the point. What is clear is that a vastly simpler algorithm has 
been presented and it is clear that there is no obvious reason why it should 
be uniformly worse than reversible jump MGMG. 
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